<?xml version="1.0" encoding="ISO-8859-1"?>
<metadatalist>
	<metadata ReferenceType="Conference Proceedings">
		<site>sibgrapi.sid.inpe.br 802</site>
		<holdercode>{ibi 8JMKD3MGPEW34M/46T9EHH}</holdercode>
		<identifier>8JMKD3MGPEW34M/45CTJ95</identifier>
		<repository>sid.inpe.br/sibgrapi/2021/09.06.15.14</repository>
		<lastupdate>2021:09.06.15.14.47 sid.inpe.br/banon/2001/03.30.15.38 administrator</lastupdate>
		<metadatarepository>sid.inpe.br/sibgrapi/2021/09.06.15.14.47</metadatarepository>
		<metadatalastupdate>2022:06.14.00.00.28 sid.inpe.br/banon/2001/03.30.15.38 administrator {D 2021}</metadatalastupdate>
		<doi>10.1109/SIBGRAPI54419.2021.00040</doi>
		<citationkey>CoelhoPratSchw:2021:GeApFa</citationkey>
		<title>A generative approach for face mask removal using audio and appearance</title>
		<format>On-line</format>
		<year>2021</year>
		<numberoffiles>1</numberoffiles>
		<size>4381 KiB</size>
		<author>Coelho, Luiz Eduardo Lima,</author>
		<author>Prates, Raphael Felipe de Carvalho,</author>
		<author>Schwartz, William Robson,</author>
		<editor>Paiva, Afonso ,</editor>
		<editor>Menotti, David ,</editor>
		<editor>Baranoski, Gladimir V. G. ,</editor>
		<editor>Proença, Hugo Pedro ,</editor>
		<editor>Junior, Antonio Lopes Apolinario ,</editor>
		<editor>Papa, João Paulo ,</editor>
		<editor>Pagliosa, Paulo ,</editor>
		<editor>dos Santos, Thiago Oliveira ,</editor>
		<editor>e Sá, Asla Medeiros ,</editor>
		<editor>da Silveira, Thiago Lopes Trugillo ,</editor>
		<editor>Brazil, Emilio Vital ,</editor>
		<editor>Ponti, Moacir A. ,</editor>
		<editor>Fernandes, Leandro A. F. ,</editor>
		<editor>Avila, Sandra,</editor>
		<e-mailaddress>luizduducoelho@ufmg.br</e-mailaddress>
		<conferencename>Conference on Graphics, Patterns and Images, 34 (SIBGRAPI)</conferencename>
		<conferencelocation>Gramado, RS, Brazil (virtual)</conferencelocation>
		<date>18-22 Oct. 2021</date>
		<publisher>IEEE Computer Society</publisher>
		<publisheraddress>Los Alamitos</publisheraddress>
		<booktitle>Proceedings</booktitle>
		<tertiarytype>Full Paper</tertiarytype>
		<transferableflag>1</transferableflag>
		<versiontype>finaldraft</versiontype>
		<keywords>computer vision, GAN, image inpainting.</keywords>
		<abstract>Since the COVID-19 pandemic, the use of facial masks in public spaces or during people gatherings has become common. Therefore, journalists, reporters, and interviewees frequently use a mask, following the public health measures to contain the pandemic. However, using a mask while speaking or conducting a presentation can be uncomfortable for viewers. Furthermore, the usage of a mask prevents lip reading, which can harm the speech comprehension of people with hearing impairment. Thus, this work aims at artificially removing masks in videos while recovering the lip movements using the audio and uncovered face features. We use the audio to infer the lip movement in a way it matches with the uttered phrase. From the audio, we estimate landmarks representing the mouth structure. Finally, the landmarks (i.e. uncovered and estimated) are the input in a generative adversarial network (GAN) that reconstructs the full face image with the mouth in a correct shape. We present quantitative results in the form of evaluation metrics and qualitative results in the form of visual examples.</abstract>
		<language>en</language>
		<targetfile>SIBGRAPI_65.pdf</targetfile>
		<usergroup>luizduducoelho@ufmg.br</usergroup>
		<visibility>shown</visibility>
		<documentstage>not transferred</documentstage>
		<mirrorrepository>sid.inpe.br/banon/2001/03.30.15.38.24</mirrorrepository>
		<nexthigherunit>8JMKD3MGPEW34M/45PQ3RS</nexthigherunit>
		<nexthigherunit>8JMKD3MGPEW34M/4742MCS</nexthigherunit>
		<citingitemlist>sid.inpe.br/sibgrapi/2021/11.12.11.46 5</citingitemlist>
		<hostcollection>sid.inpe.br/banon/2001/03.30.15.38</hostcollection>
		<agreement>agreement.html .htaccess .htaccess2</agreement>
		<lasthostcollection>sid.inpe.br/banon/2001/03.30.15.38</lasthostcollection>
		<url>http://sibgrapi.sid.inpe.br/rep-/sid.inpe.br/sibgrapi/2021/09.06.15.14</url>
	</metadata>
</metadatalist>